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ABSTRACT 


The  discrete  finite  Fourier  transform  can  be 
regarded  as  a  matrix  operation,  since  each  element 
of  one  member  of  the  pair  is  a  linear  combination  of  all 
the  elements  of  the  other  member.  The  N-by-N  cyclo- 
tomic  matrix  (W)j^  =  N  **  exp  [-2iri  jk/N]  which  per¬ 
forms  the  transform  is  unitary  and  has  eigenvalues 
A  =  1  and  +_  i.  Clearly  the  eigenvectors  of  W  are 

those  functions  which  are  their  own  finite  Fourier 
transform  multiplied  by  +  1  or  +  i.  One  class  of  such 
functions  are  aliased  Hermite  functions,  which  are 
related  to  the  theta  functions. 


We  discuss  analytically  some  curious  properties  of 
these  functions,  which  were  suggested  by  numerical  calcu¬ 
lations  of  the  eigenvectors. 


We  demonstrate  a  remarkably  simple  relation 
between  a  periodic  function  of  a  discrete  variable 
and  its  discrete  finite  Fourier  transform,  namely 
that  the  absolute  values  of  their  expansion  coeffi¬ 
cients  in  these  eigenvectors  are  the  same.  We 
suggest  a  canonical  form  for  such  functions  (with 
respect  to  the  finite  Fourier  transform)  in  which  the 
transform  can  be  done  by  inspection. 
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1 .  Introduction 


Popularization  of  the  fast  Fourier  transform 
algorithm  by  Cooley  and  others  (for  example,  Cooley 
et  al . ,  1967)  has  caused  renewed  interest  in  the 
theory  of  the  discrete  finite  Fourier  transform, 
which  was  neglected  during  the  years 
when  statisticians  preferred  to  calculate  the  spectra 
of  digital  time  series  via  mean  lagged  products.  In 
this  paper  we  discuss  some  properties  of  the  eigen¬ 
vectors  of  the  matrix  that  performs  the  discrete 
finite  Fourier  transform. 

For  continuous  time  we  have  the  Fourier  trans¬ 
form  pair: 


X(f)  = 

/ — \ 

v - ' 

X 

8 

8 _ i 

-2-rrift  . . 
e  dt 

(1.1) 

x(t)  = 

.00 

x(f) 

.  *00 

+  2irift  Ar 
e  dt 

(1.2) 

provided  these  integrals  exist.  The  corresponding 
discrete  finite  Fourier  transform  pair  is: 

N-l 

Xk  =  N"*5  l  x.  e’2TT1J’k/N  k  =  0,  N-l  (1.3) 

k  j=0  J 

Xi  =  N-*5  Y  Xv  e+27riJk/N  j  =  0,  N-l  (1.4) 

J  k»0  K 


-1- 


for  which  the  completeness -closure  relation  is 


N- 1 


l 

j=0 


exppTrij  (k  -  k*  )/N]  =  <$£, 


where 


6 


k 

k' 


sx 


f  1  when  k  =  k* 
l  0  otherwise 


(mod  N) 


(1.5) 


(1.6) 


The  relation  between  the  discrete  finite  Fourier 
transform  and  the  continuous  -  time  Fourier  transform 
is  (see,  for  example,  Cooley  et  al, ,  1967)  that  if 
x(t)  and  X(f)  are  a  continuous-time  Fourier  transform 

pair,  then  xp(At)  and  Xp(kAf)  are  a  discrete  finite 

Fourier  transform  pair,  where 

00 

Xp(jAt)  =  T  N  l  x  ( j  a  t  +  mNAt)  (1.7) 

m=  -  oo 

00 

Xp(kAf)  =  l  X(kAf  +  mNAf)  (1.8) 

m=  -  oo 

where  N  is  the  number  of  sample  points  in  x  and  X,  and 
T  =  NAt.  The  form  of  (1.7)  and  (1.8)  is  obviously  due 
to  the  aliasing  in  both  time  and  frequency  which 
occurs  when  x(t)  and  X(f)  are  sampled. 

We  define  a  matrix  W: 

Wjk  -  N'1*  e-2’1^  n  .9) 


-2- 


in  order  to  write  (1.3)  and  (1.4)  more  compactly  in 
matrix  notation: 


(1.10a) 

(1.10b) 


X  =  W  x 
x  =  W+X 

where  x  and  X  are  vectors  whose  elements  are  the 
sample  values  of  the  data  and  the  transform  respectively, 
and  the  dagger  denotes  Hermitian  conjugation.  W  is 
clearly  unitary,  and  it  satisfies  the  equation 

W4  =  I  (1.11) 

so  that  its  eigenvalues  are  X  =  +_  1  and  +_  i.  The  problem 
of  determining  the  multiplicity  of  these  eigenvalues  is 
equivalent  to  the  problem  of  evaluating  the  trace  of  W, 
i.e.,  the  Gaussian  sum 

.  N 

S(1»N)  -  N  I  exp  (2-rrik^/N)  =  N"5  tr(W) 
k=l 

the  value  of  which  is  well  known  (Erdelyi  et  al.,  1955, 
section  17.6) . 

Carlitz (1959) showed  that  a  multiplicity  rule  for  the 
eigenvalues  can  be  derived  from  the  fact  that  the  charac¬ 
teristic  polynomial  of  W  is: 


-3- 


f(X)  =  (X  -  1) 2  CX  +  i)  (X  +  1)  (X4  -  l)^"1 

f(X)  =  (X  -  1)(X4  - 

f(X)  =  (X2  -  1)(X4  -  i)*CN-2) 

f  CX)  =  (X  -  i)  (X2  -  1)  (X4  -  1)^N“3) 


when  N=0  (mod  4) 
N=1  (mod  4) 
Ne2  (mod  4) 
NE3  (mod  4) 


A  simple  way  to  see  the  multiplicity  is  to  count 
the  occurrences  of  each  of  the  fourth  roots  of  unity 
arc  r;d  the  unit  circle  in  the  following  way:  For  N 
odd,  start  with  +1  and  step  around  counterclockwise, 
counting  each  root  in  turn,  up  to  a  total  of  N  of 
them  -  e.g.,  for  N  =  5  the  eigenvalues  are  1,  -i,  -l, 
+i,  1.  For  N  even,  however,  the  last  occurrence  of 
i  or  -i  is  skipped  -  e.g.,  for  N  =  6  the  eigenvalues 
are  1,  -i,  -1,  +  i,  i,  -i, 


-4- 


It  is  clear  that  the  eigenvectors  of  W  are  those 


functions  of  a  discrete  variable  which  are  equal  to 
their  own  discrete  finite  Fourier  transforms  multiplied 
by  +  1  or  +  i .  We  can  get  a  set  of  these  from  the 
relationship  (see  Magnus  et  al . ,  1966): 

(e"^  Hk[(2Tr)Jst]}e‘2TTlft  dt  =  i-k  (e-7Tf2  H,  [  (2tt)^  f  ] }  (2.1) 

-00  K  K 

where  Hk(x)  is  the  k'th  Hermite  polynomial: 

Hk(x)  =  (-l)k  exp (x2)  dk[exp(-x2)]/dxk  (2.2) 


That  is, 

2 

u(t)  =  e_Trt  Hk[(2Tr)*»t] 

is  a  solution  of  the  singular  integral  equation: 


(2.3) 


00 

u(t)  e"2TTlft  dt  =  Xu(f)  (2.4) 

j  -00 

with  X  +  l,  +_  i. 

The  functions  (2.3)  do  not  exhaust  the  solutions 
of  (2.4),  since  there  are  infinitely  many  solutions 
for  X  =  +  1:  for  example,  u(t)  =  sech(TTt)  satisfies 
(2.4)  with  X  =  1,  and  in  fact,  if  x(t)  and  X(f)  are 
any  Fourier  transform  pair,  then 


is  a  solution  of  equation  (2.4),  with  X  =  a  =  +_  1  if 
x(t)  *  x(-t)  and  with  A  *  -a  =*  +_  i  if  x(t)  =  -x(t). 

is  a  solution  of  (2.4)  with  A  =  +  1. 

From  equations  (1.7)  and  (1.8)  we  see  that 
eigenvectors  of  W  which  correspond  to  the  functions 
(2.3)  are: 

uk(j)  =  l  e_Tr(j  +  raN)2/N  Hk[  (2Tr/N)is  (j  ♦  mN)] 
m=-°° 

where  uk(j)  denotes  the  j'th  element  of  the  k'th 
eigenvector.  In  deriving  (2.6)  we  made  use  of  the 
fact  that  if  x^QAt)  is  to  be  proportional  to  Xp(kAf), 
then  At  =  Af  =  N*1*.  Cooley  et  al .  (1967)  state 
(2.6)  omitting  the  Hermite  function.  Since  H0(t)  =  1, 
f2.6)  is  a  generalization  of  their  result. 

These  functions  of  j,  k,  and  N  are  clearly 
periodic  in  j  with  period  N;  for  even  k  the  functions 
are  symmetric  about  the  middle  of  a  period  and  for 
odd  k  they  are  antisymmetric.  McClellan  and  Parks  (1972) 
pointed  out  that  this  is  a  general  property  of  the 
eigenvectors  of  W. 

An  easy  way  to  see  this  general  property  follows 


(W2) 


kj 


’N-j  » 


k, j  ■  0,  1,. . .  ,  N-l 


k 

where  6.. 

N-J 

(1.6). 


is  the  Kroneker  delta  defined  in  equation 


Thus  we  have: 


tr 


col(u0,...,uN)  -  icol(u0 . uN) 


where  the  sign  is  positive  for  A  =  +  1  and  negative  for 


A  »=  +  i.  From  (2.7)  it  is  clear  that 

Uj  =  ufj-j  for  A  *  +_  1  and 

Uj  ■  "uN.j  for  A  *  +_  i 


and 


1,  N-l 


Uq  =0  for  A  =  +_  i 

UN/2  *  ®  for  ^  =  i  and  N  even 

We  see  from  (2.1)  that  the  order  index  k  is 
related  to  the  eigenvalues:  the  functions  (2.6)  are 
eigenvectors  of  W  with  eigenvalues 


(2.7) 


(2.8) 


(2.9) 


2.10) 
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1 


X  =  < 


- 1 
-1 


for  k=0  (mod  4) 
k=l  (mod  4) 
k=2  (mod  4) 
kE3  (mod  4) 


(2.11) 


In  this  paper  we  do  not  consider  other  functions 
which  satisfy  (2.4),  for  example 


oo 

u ( j )  =  £  sech  [ttN-15  (j  +mN)  ] 


m=-°° 


(2.12) 


(2.6)  is  a  sequence  of  functions  which  are  multi¬ 
ples  of  the  eigenvectors.  Since  there  are  infinitely 
many  functions  in  the  sequence,  clearly  there  are  many 
linear  dependences.  The  functions  in  any  infinite 
sequence  associated  with  a  given  eigenvalue  of  W  must 
also  contain  many  linear  dependences,  since  the 
multiplicity  of  the  eigenvalue  is  a  bound  on  the  number 
of  linearly  independent  eigenvectors  associated  with 
that  eigenvalue. 


We  notice  that  in  the  discrete  case  the  property 
(2.5)  also  holds  true. 


-8- 


There  is  an  interesting  relation  between  the  eigen¬ 
vectors  of  W  and  a  function  which  occurs  in  number  theory: 
the  Legendre- Jacobi  symbol  is  defined  as: 

when  m  =  z2  (mod  N)  /  0 
when  m  =  z2  (mod  N)  +  0 
when  m  =  0  (mod  N) 


1 


l  0 


(2.13) 


where  z  is  an  integer  (ErdSlyi  et  al.t  1955,  section  17.5). 
It  can  be  shown  that 


for  Nil  (mod  4) 


( 


m 

IT 


for  N  =  3  (mod  4) 


(2.14) 


where  E^  is  the  vector  space  spanned  by  the  eigenvectors 
associated  with  the  eigenvalue  X. 


-9- 


^ •  :^Q.mc  general  properties  of  the  eigenvectors  of  W 

We  calculated  *he  functions  (2.6)  to  twenty 

significant  figures  for  N  =  2,  3 . 30  and  k  =  0,  1, 

60.  A  number  of  interesting  properties  emeiged 
from  the  calculations,  which  led  to  the  following 
general  conclusions. 

We  consider  the  even  vectors 

{6j0  +  6N-jQ}  Jo  =  °»1 . -  1  *  N2) 

and  ihe  odd  vectors 


(3.1) 


j  0  '  .  ^(N  -  1  -  N2) 


where  N2  =  N  (mod  2)  >_  0.  With  these  vectors  we  form  the 
following  total  systems  of  vectors  (which  are,  however, 
not  minimal  systemsj  in  the  spaces  : 

N"'5  cos(2TTj0k/N)  +  4(6^'  +  6*_..  )  e 

and  °  ° 

N'2  sin  (2?r  j  Qk/N)  +  ^(-6^  +  6*  .  )e  E(1^ 

u  -  J0  N"V  11 

These  systems  contain  almost  twice  as  many  vectors  as  the 
dimensionality  of  E^N^ ;  orthogonali zing  these  systems 
separately  for  each  X  it  is  possible  to  get  a  full  system 
of  orthonormal  eigenvectors  of  W. 


(3.2) 


(3.3) 


-10- 


Consider  the  vectors  with  elements  Jq  =  0  from 
and  with  element  jQ  =  1  from  E^  Then  for  any  N, 


col(l  +  H'2,  1,.. .  ,1)  e  £ CN) 


(3.4) 


col(0,  aj  ♦  N\  a2,...,aN_2,  ♦  N*)  e  E™ 


(3.5) 


where 


ak  -  2  sin(27rk/N) 


We  notice  that  =  0  for  X  =  i  and  N  =  2 ,  3,  and  4, 


and  that  n|N^  =  1  for 


A  =  1  and  N  =  1,  2,  3; 

A  =  i  and  N  =  5,  6,  7  8; 

A  =  -1  and  N  =  2,  3,  4,  5; 


A  =  -i  and  N  =  3,  4,  5,  6. 


Consequent]/  the  following  are  identities  for  the  functions 


u 


(N). 
k  • 


u4p+3^  =  0 


N  =  1,  2, 


(N) 


(N) 


4p 


(1  -  N^)"1 


N  =  2,  3 


u 


(N) 

4p+2 


(j)/u 


(N) 
4p  +  2 


(0)  =  (1  -  nY1 


N  =  2,  3, 


U(N)  m 

u4p+l  ^  J  a  2  sin(2Trj/N) 
^ITuT  2  sin(2-rr/N)  ♦  N'* 


N  =  3,  4, 
and  j  =  1  (mod  N) 


UCN)  m 

4p+3  ^ J  _  2  sin(2Trj/N) 
U4pi3(l)  2  sin  (2tt/N)  - 


N  =  5,  6, 
and  j  =  1  (mod  N) 


where  p  is  a  positive  integer 


We  also  notice  that  a  linear  combination  of  eigen¬ 


values  always  exists  such  that 


l  ak  u(N)  =  coli 
k=l  k  ~k 


1. 


1  +  X 


w 


•  e  o 


(3.6) 


where  X  =  1  for  M  =  n+  and  kEO  (mod  4) 
X  =  - 1  for  M  =  n"  and  kE2  (mod  4) 


and  m+  and  n"  are  the  number  of  positive  and  negative 
eigenvalues  respectively. 

Since  nj^  =  2  when  X  =  1  for  N  =  4,  5,6,  7,  and  when 
X  =  -1  for  N  =  6,  7,  8,  9,  a  number  a  can  be  found  for  the 
above  combinations  of  X  and  N  and  for  arbitrary  linearly 
independent  u£N^  and  u^^ ,  where  k  =  m  =  1  -  X  (mod  4)  such 
that 


U^°(j)  ^  a  U?N!m  =  1 
u£^  (0)  +  a  (0)  1  +  XN 


(3.7) 


From  (2.8)  and  (3.3)  we  have  full  bases  in  E 


-13- 


5 


1 


u  +  5  ,  1,  1,  1,  i)t  e2  .  co>  1#  _lf  _lf 


[ 


E-1  ■  (c3  =  (1  -  i,  1,  !,  !) ) 

E*i)  "  (°.  “±.  1.  -1,  -a,) 


J  J 


where  at^  -  22(3  -  5*)^  +  2(5  -  5^)^] 

It  is  of  interest  to  display  a  few  of  these  results 
explicitly : 

a.  For  all  integers  p  and  for  j  =  1,  2,  3,  4: 


m=-oo 


l  q-tt  (j  +5m)  /  5 

7 - 


l  e-5""1'  » 
m=-oo  2+4p 


H2  +  4p  C  Cj  +  Sm)  (277/5)**] 
[  5m  (2tt/5)^] 


1 

i  -  /r~ 


(3.8) 
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b.  For  all  integers  p  and  for  j  -  1  and  2: 


l  e-*0*3m)2/3  h2+4  [  C21./3J*5] 

m=-°°  _ _ _ : 

l  e-3™  H2+4  [7>m(2*/3)h] 

m=-°°  F 

c.  For  all  integers  p  and  for  j  =  1  and 


1 


1  -  /T~ 


2: 


J  e-"Cj+3n.)  2/3  h„  [(j*3m)(2n/3)‘i] 
m=-°° _  _ _ 

l  e’3™  H4  [3mC27r/3)Si] 
m=-°°  ^ 


1 

1  +  S5~ 


(3.9) 


(3.10) 


4 o  Miscellaneous  observations  prompted  by  the  numerical 
calculations 

We  have  not  investigated  the  linear  dependence  of  the 
functions  (2.6)  beyond  noticing  that  for  N=2  through  8  the 
eigenvectors  corresponding  to  a  given  eigenvalue  are  not 
only  linearly  dependent,  but  parallel  or  antiparallel;  that  is 

ujjN)0)  -  i  F(N,k)  (4 

It  appears  that  in  certain  sets,  e.g.,  kE3  (mod  4)  for 
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N  -  b  and  7,  and  for  k  =  1  (mod  4)  for  N  =  4,  eigen¬ 
vectors  with  k  prime  tend  to  be  antiparallel  significantly 
more  often  than  those  with  k  composite,  much  more  than 
the  distribution  of  primes  in  the  interval  0<k<60  would 
suggest. 

For  primes  modulo  8,  with  the  single  exception  of 
k=3  (mod  4),  the  eigenvectors  with  k=5  (mod  8)  and  k=7 
(mod  8)  are  antiparallel  to  the  vector  for  k  =  0  about  four 
times  as  frequently  as  the  eigenvectors  with  k=l  or  3 
(mod  8).  In  the  exceptional  case  the  4:1  ratio  is  reversed. 


5.  Relationship  to  theta  functions 

Writing  out  the  quadratic  factor  in  (2.6),  we  have: 


ukO)  -  e-"j2/N  J  -  2,mj  T)1, 

m=-oo  K 


(5.1) 


Comparison  with  the  theta  function 


e3(z»t)  =  I  e 


2 . 

-Trm  it  +  2miz 


m=-oo 


(5.2) 


(Bellman,  1961)  shows  that  the  eigenvectors  (5.1)  are  a 
generalization  of  these  theta  functions  for  the  particular 
arguments  t  *  iN  and  z  =  irij.  As  such  they  may  be  of 
mathematical  interest. 


-16- 


6.  Generating  functions  for  the  eigenfunctions 

The  generating  function  for  the  Hermite  polynomials 

is  : 


2xz 


z 2  ~  l  |t 

k=0  J 


(6.1) 


(see,  for  example,  Szego,  1959).  Carlitz  has  pointed  out 
(personal  communication,  1970)  that  it  follows  from  (2.6) 
and  (6.1)  that  the  generating  function  for  the  eigenvectors 


u 


(N) 


(j)  is  : 


L  uk^ET  = 


k=0 


2  +0°  _  7 

ez  l  exp{-TT  [  (j  +nu%)  -z/2‘N/V]  z/N  } 

m=-°° 


(6.2) 


which  can  be  put  in  the  form  : 

oo  k  Z^ 

l  uk(^FT  =  e  ur(j-z/Wrr)  (6.3) 

k=0  K  KI  u 

7.  Expansion  of  arbitrary  vectors  in  the  eigenvectors  of  W 

-x2/2 

From  the  completeness  of  the  functions  e  '  H^(x)  in 

the  interval  (-<*>,  °°)  it  follows  that  the  system 
(u^,  k=0,  +  1,...}  is  complete.  Thus  any  arbitrary  data 
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vector  x  can  be  expanded  in  terms  of  these  eigenvectors: 


N 

i  -  ak  “k  (7-D 


where 


(7.2) 


Now  take  the  finite  Fourier  transform  of  both  sides  of  (1.10a): 


X  =  W  x  =  W 


N 

l 


k=i  a*  =  kii  a*  w  ^  = 


N 

l 


N 

Xk  ak  ~k 


(7.3) 


where  X  is  the  finite  Fourier  transform  of  x.  Now  since 
=  1  an<i  i  i»  we  see  that  there  is  a  remarkably  simple 

relation  between  a  periodic  function  of  a  discrete  variable 
and  its  discrete  finite  Fourier  transform:  the  expansion 
coefficients  of  both  in  terms  of  the  eigenvectors  of  W 
have  the  same  absolute  value,  and  x  and  X  differ  only  in  the 

N  N  * 

sign  and/or  the  realness  of  some  of  the  terms  in  the  expansion. 

Thus  there  may  exist  for  discrete  time  series  a  canonical 
form  (with  respect  to  the  finite  Fourier  transform)  in  which 
the  transformation  can  be  done  by  inspection.  It  would 
therefore  be  of  interest  to  find  efficient  algorithms  for 
computing  the  eigenvectors  (2.6)  and  the  expansion  coefficients 
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(7.2);  it  would  also  be  of  practical  importance  to  re-examine 
digital  data  processing  procedures  for  time  series  expressed 
in  this  canoni ;al  form. 

A  similar  statement  can  be  made  for  the  functions  (2.3) 
and  the  continuous- time  Fourier  transform  (1.1) -(1.2). 
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